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Start Root Demographic Information Extraction Routine 
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Select a set of demographic characteristics 
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Assign a set of acoustic confidence scores to the demographic characteristics 



Assign a set of substantive confidence scores to the demographic characteristics 



Combine the acoustic and substantive confidence scores for each of the 
demographic characteristics 
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Tailor information presented to the contact using the set of combined confidence 

scores 
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Start Demographic Information Extraction Routine 
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Initiate a dialog between contact and call handling system 



Retrieve and present predetermined dialog segments from a dialog database to 

the contact 



Receive responses and information requests back from the contact which are 
then stored in a contact database 



Activate a set of demographic classifiers, including an acoustic classifier and a 

set of substantive classifiers 



Divert a copy of the contact's speech signal utterances to the acoustic classifier 



Extract from the contact's speech signal features relating to one or more 
demographic characteristics 



Compare the contact's speech signal features to a predefined body of speech f 

signal features 



Store the confidence scores in a demographic data portion of the contact 

database 



Present the contact with one or more probing dialogs retrieved from the dialog 

database 
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Compare the contact's responses to a predefined body of responses generated 
using neural net techniques and assigns a set of confidence scores to each of the 

demographic characteristics 



Store the confidence scores in the demographic data portion of the contact 

database 
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Present the contact with one or more multiple choice questions retrieved from 

the dialog database 
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Fig. 3A 
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Compare the contact's responses to a predefined body of responses generated 
using neural net techniques and assigns a set of confidence scores to each of the 

demographic characteristics 
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Store the confidence scores in the demographic data portion of the contact 

database 
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Retrieve the confidence scores stored in the demographic data for the various 

demographic characteristics 



Calculate a combined confidence score for each of the demographic 

characteristics 



Dynamically adjust each classifier's weight using ground truth data 



Dynamically adjust a first classifier's weight for a given demographic 
characteristic if the first classifier's confidence score differs from a second 
classifier's confidence score for that given demographic characteristic by a 

predetermined amount 
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Instruct one or more of the classifiers to continue classification of the contact's 

demographic characteristics until either a predetermined set of demographic 
characteristics have either individually or combined confidence scores that are 
above a predetermined threshold or until a predetermined time period has 

expired 
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Store the combined confidence score for each of the demographic characteristics 

in the demographic data 



Retrieve the combined confidence score from the demographic data 



Tailor information presented to the contact using the combined confidence 

scores 
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